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The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment See 37 CFR 1.704(b). 

Status 

I) 13 Responsive to communication(s) filed on 24 October 2005 . 
2aM This action is FINAL. 2bM This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) |3 Claim(s) 1-42 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) M Claim(s) 1^42 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)£3 The drawing(s) filed on 02 October 2001 is/are: a)IE accepted or b)D objected to by the Examiner. 
Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

I I) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or(f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* see the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 



Claim Rejections - 35 USC 3 103 



1 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth 
in section 102 of this title, if the differences between the subject matter sought to be patented and the prior 
art are such that the subject matter as a whole would have been obvious at the time the invention was made 
to a person having ordinary skill in the art to which said subject matter pertains. Patentability shall not be 
negatived by the manna* in which the invention was made. 



2. Claims 1-30 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Balakrishnan (6,233,559) in view of Scott et al (6101473V 



As per claim 1-4, 12-16, and 22-25, 34,35,37,38,40,41, Balakrishnan (6,233,559) 
teaches: 

receiving information about a recognized phrase from a speech recognition engine 
(col. 4, lines 18-19 and 31-33); 

selecting, based on the recognized phrase an inherent handler function and 
handling information from sets of handling information associated with a different 
application, based on identifying the application that is a focus of the recognized phrase 
(col 4, lines 35-40 and 47-51); 

having first located the sets of handling information, when the execution of the 
associated application is initiated (col. 5, lines 1-5). 
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loading a first grammar for a first application that is automatically selected and 
loading a second different grammar for a second automatically recognized application 
(col. 4 lines 40-66) 

. As per claims 1,12, and 22, Balakrishnan (6.233,559) does not explicitly teach 
the speech engine separate from the applications themselves, however, Scott et al 
(6101473) teaches the speech server to be separate from the applications themselves (Fig. 
7). Therefore, it would have been obvious to one of ordinary skill in the art at the time 
the invention was made to modify the teachings of Balakrishnan with a separate speech 
engine because it would advantageously allow for more than one application to access the 
speech engine (Scott et al, col. 2 line 65 - col. 3 line 2). 

The combination of Balakrishnan (6.233,559) in view of Scott et al (6101473) 
does not explicitly teach "utilizing a first API at a speech service separate for the speech 

engine first application programming interface", however, Comerford et al (6748361) 

teaches separate user interface files on a different platform, separate from the spoken 
language engines (Fig. 3, subblock 330, subblock 3200, and subblock 3420). Therefore, 
it would have been obvious to one of ordinary skill in the art of speech interfaces at the 
time the invention was made to modify the teachings of the combination of Balakrishnan 
(6.233.559) in view of Scott et al (6101473) to include separate handling functions for the 
speech because it would offer a more flexible speech interface ( Comerford et al 
(6748361). col. 5 lines 40-47). 
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As per claim 5, Balakrishnan (6,233,559) teaches downloading the applications 
and potentially the speech engine for the user (col. 3 line 55 - coL 4 line 10). 

As per claims 6, 9, 10, 17, 20, 21, 26, 29, and 30, Balakrishnan (6,233,559) 
teaches: 

detecting a change of focus from a first to a second application (col. 4, lines 45- 

47); 

inherently producing a second grammar based on the handling information 
associated with the second application and loading the second grammar into the speech 
recognizer engine (col. 5, lines 16-18 with Figure 2, elements 44, 48, or 46 and 50); 

directing the operating system to provide notification in response to the focus 
changing and receiving notification from an operating system (col. 4, lines 41-45 with 
col. 5, lines 1-5). 

As per claims 7, 18, 27, and 28, Balakrishnan (6.233,559) does not teach 
generating an uncompiled grammar based on the handling information and compiling it 
into a binary format. However, it would have been obvious for an artisan at the time of 
invention to do this (if it had not been already done) to enable the speech recognizer to 
properly interpret the input speech commands. 
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As per claims 8 5 19, and 28, Balakrishnan (6,233,559) does not teach unloading a 
first grammar associated with the first application from the speech engine. However, it 
would have been obvious for an artisan at the time of invention to do this when focus has 
shifted away from the first application so that the speech recognizer would not have to 
consider irrelevant commands. 

As per claim 11, Balakrishnan (6.233,559) does not explicitly teach loading the 
grammar for a second engine onto the speech engine when the focus is changed from a 
third application to the second application. However, it would have been obvious for an 
artisan at the time of invention to do this (if it had not already been done) to enable the 
speech recognizer to properly interpret the commands for the second application. 

As per claims 36.39,42. Balakrishnan (6.233,559) teaches sapi and jsapi (Fig. 3, 
subblocks 32,34, and 102). 

3. Claims 31-33 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Balakrishnan (6233559) in view of Scott et al (6101473) in view of Comerford et al (6748361) in 
further view of Weber (6532444) . 

As per claims 3 1-33, Balakrishnan (6233559) in view of Scott et al (6101473) in 
view of Comerford et al (6748361) does not explicitly teach wildcard options for the 
recognized phrase, however, Weber (6532444) teaches context specific grammars 
(abstract) wherein wildcards are utilized (col. 8 line 63 - col 9 line 7). Therefore, it 
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would have been obvious to one of ordinary skill in the art of speech control processing 
to modify the context grammar of Balakrishnan (6233559) in view of Scott etal 
(6101473) in view of Comerford et al (674836lW ith a wildcard function because it 
would allow for user specific facts to be stored ( Weber (6532444), col. 3 lines 30-35). 

Response to Arguments 

4. Applicant's arguments filed 10/24/2005 have been fully considered but they are not 
persuasive. As per applicants arguments on the middle of page 15 of the response, examiner 
disagrees and argues that the Balakrishnan reference teaches a grammar selection for each 
apphcation/command; that is, there is a unique correspondence between command and grammar. 
As per applicants argument presented on the top of page 16 of the response, examiner disagrees 
and argues that the combination of Balakrishnan in view of Scott teaches the distribution of 
speech recognition grammar based upon the particular application. 

Conclusion 

5. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1. 136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
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the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Michael Opsasnick, telephone number (571)272-7623, 
who is available Tuesday-Thursday, 9am-4pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mr. Wayne Young, can be reached at (571)272-7582. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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